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ABSTRACT 



The accuracy of the discrete reliability growth model developed by Army Material 
System Analysis Activity (AMSAA) is analysed. The mean, standard deviation, and 
95 percent confidence interval of the estimate of reliability resulting from simulating the 
AMSAA discrete reliability growth model are computed. The mean of the estimate of 
reliability from the AMSAA discrete reliability growth model is compared with the mean 
of the reliability estimate using the Exponential discrete reliability growth model devel- 
oped at the Naval Postgraduate School and with the actual reliability which was used 
to generate test data for the replications in the simulations. The testing plan simulated 
in this study assumes that the mission tests (go-no-go) are performed until a predeter- 
mined number of failures occur at which time a modification is made. The main results 
are that the AMSAA discrete reliability growth model always performs well with con- 
cave growth patterns and has difficulty in tracking the actual reliability which has con- 
vex growth pattern or constant growth pattern when the number of failures specified 
equal to one. 
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I. INTRODUCTION 



The test-analyze-and-fix scenario is frequently followed in order to achieve high re- 
liability under current DOD design and development policies during early development. 
An item will usually be tested until it fails. The failure is analyzed to determine its 
cause, and what needs to be done to remove the cause of failure. Appropriate changes 
are made and more items are tested until the next failure occurs. After each modifica- 
tion to the item, it has a new reliability and after the K' h modification we are in the K' 1 ’ 
reliability growth phase and all items tested in this phase have common reliability R t . 
This procedure is repeated several times until the requirement for reliability is achieved. 
Through this procedure a reliability growth pattern is established. Reliability growth 
models have been developed to estimate reliability from phase to phase for this type of 
test program. One such model is the Army Material System Analysis Activity 
(AMSAA) Discrete Reliability Growth Model. 

The purpose of this paper is to perform an accuracy analysis of the AMSAA discrete 
reliability growth model. Performance evaluation of the AMSAA discrete reliability 
growth model was done using monte carlo simulation to generate test data which in turn 
was used to exercise the AMSAA computer program to compute the estimate of the 
reliability for each phase. The reliability estimates obtained from the AMSAA model 
are compared with the actual reliability in a predetermined sequence of reliabilities which 
used to generate test data. In addition these values are compared with the reliability 
estimate obtained from the Exponential discrete reliability growth model which has been 
analyzed at the Naval Postgraduate School [Ref. 1, 2, and 3]. General description of the 
analysis used in this paper is described below : 

For each phase, 

• Assign value R, , the reliability for i' 1 ' phase 

• Specify F t , the number of failures specify to stop the phase 

• Generate iV, , the number of tests needed to obtained F, failures 

• Collect the test data, A, and F, 

• Compute R,, the estimate of R, 

• Replicate this scenario 500 times 

• Compute the sample mean R, and sample standard deviation S' 

“i 
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• Compute a 95% confidence interval for £[#,] 

• Compare R, with R , in graphical form 

• Compare R, with the estimate of reliability using the Exponential discrete reliability 
growth model with the same data 

• Prepare appropriate graphs. 
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II. AMSAA DISCRETE RELIABILITY GROWTH MODEL 



The AMSAA discrete reliability growth model [Ref. 4) was developed by L.Crow in 
19S3 is based on a learning curve approach that had been mentioned by Duane [Ref. 
5]. This model is applicable when items under test are scored as success or failure. 
The model is derived from a reliability growth model for continuous data , i.c., time to 
failure data. It is based on the Duane reliability growth concepts. 



A. INTERPRETATION OF LEARNING CURVE PROPERTY 

Let C(t) be the cumulative failure rate, K(t) be the total number of failures by time 
t, where t is the cumulative test time. The ratio of K(t) and t is equal to C(t) 




Duane observed that In C(t) was linear when plotted against In t 
That is, 



In C(r) = <5— a In t 

Duane expressed this relationship differently as follows 
Kit) . 

In — - — = d—a In t 

, Kit) s 
In r* = d 

. m 
ln — = o 

m s 

p-a 

let 1 — a = p 
and let e‘ = ). 

K{t) = ho 



Consequently, if ln C(t) is a linear function of ln t, this implies K(t) = h p , which is the 
learning curve property for K(t). [Ref. 4 page 1]. 
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B. AMSAA DISCRETE RELIABILITY GROWTH MODEL DEVELOPMENT 

The discrete reliability growth model developed at AMSAA uses attributes data. 
This model is described as follows : 

A' = Number of trials for configuration / , i = 1,2 k 

T, = Cumulative number of trials through configuration i 

T\ = ^'i 

T : = A’, + A j 
In general : 

T, = A’ + A’ + A' + ... + .V, 

A/, = Number of failures for configuration i 

Ai = Cumulative number of failures through configuration i 

A', = A/, 

K 2 = . 1 /, + m 2 

In general : 

A, = A/| + A / 2 + A /3 t ... 4- A/, 

£[A'j = Expected value of A" . 

The model assumes that log £[A'] is linear when plotted against log T, . This implies 
£[A’,] = ;. 7?. [Ref. 4 page I to 4], 

£[A',] = ;.7T?= P.A’, 

/ 7? 

P = — — 

' 1 .v, 

£[A 2 ] = /7?= A..V, + A 2 A- 

;.7I = ;.t? + a 2 a 2 



at?-;. 7 ? 

v 2 

In general : 



£ = 






A'. 



[Ref. 4 page 5 to 6]. 
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C. ESTIMATION PROCEDURE FOR AMSAA DISCRETE MODEL 

\ A 

The maximum likelihood estimates /. and /? for / and /? were derived by AMSAA as 
follows : 

Let, 

P, — Probability of failure for configuration i 

P, = Estimated failure probability for configuration i 
R ( = Reliability for configuration i 

R, = Estimated reliability for configuration i 
Then 

A' 

R,= \-P, 

A A 

where maximum likelihood estimates of X and /? are values satisfying : 



•H 



y i -M i 



[/Tf-/7t,] + /7JL,] 



1=1 

and, 



[;.7f In r, in r M ]- o 



1=1 



Mi 



■V,-M 



[;. 7? [iV i -;.7r + ;.7T_ l ] 






[Ref. 4 page 10 to 12]. 



In this paper ). and [1 were computed using the AMSAA computer program. 



5 



III. EXPONENTIAL DISCRETE RELIABILITY GROWTH MODEL 



The Exponential discrete reliability growth model has been analyzed at the Naval 
Postgraduate School in two theses (Ref. I, 2], and by Corcoran and Read [Ref. 3], where 
Corcoran and Read have compared several popular reliability growth models. This 
model serves as a model comparison to the AMSAA discrete reliability growth model. 
The Exponential discrete reliability growth model uses only attribute data. It does not 
require any assumption about the distribution of the time to failure. This model is de- 
scribed briefly as follows : 



R, = The reliability of the component in phase / 

R, = 1 — exp{ — (a 4 - Pi)} where / = 0. 1, 2, ... 

/ = 0 means the phase prior to any modification 

The parameter estimates a, and /?, of a and /? for phase / are computed using linear 
regression methods and an unbiased estimator for (a + /?/) 

F, =the total number of failure during phase / 

.V /f =the number of tests between the (j — l) rt failure and j' h failure, including the j' h , 



Yji = unbiased estimator of (a + /?/) using j ,h sequence test in phase i 
An unbiased estimator Y Jt for (a + pi) [Chernoffand Woods 1965] is known to be : 



Let : 



in phase i 
j= 1, 2, 3, ..., F, 




0 




if Nj,i —2 



for i = 0,1,2,... and j= 1, 2, 3, ... ,F t . 



Since iV, , , ,V ; 



, .V f are independent random variables, then : 



6 



is also an unbiased estimates for (a + />/) . 



— + h,< + "■ + Y Fr ,) 

Y ‘ = l 

The least square estimates a, and /?, for a and /i at phase i are : 

i 

(>i = — for /'= 1, 2, 3,... 

t(/-o 2 

7=0 

and, 

a,= Y-P,l for /= 1,2,3,... 

where : 

rr _ ( Ti + + •" + f /) 

('+ 1 ) 

- ( 0 + 1 + 2 + ••• + /•) 

(/+1) 

A 

By using a, and /?,. the estimate of reliability for every phase i can be computed as fol- 
lows : 

/?, = 1 - EXP{ - (a, + /?, /)} for /= 1,2,3,... 

A 

The estimate of reliability for the original version of the component R 0 is given by : 

Ro = 1 - EXP{ - Y 0 ] . 

[Ref. 6 page 3-1 to 3-3]. 

In this paper the value of the mean regression estimate R, of reliability and the value 
of standard deviation of the estimate of reliabilitv S? were obtained from a computer 
program used in J. Chandler thesis [Ref. 2]. The equations for computing the reliability 

A 

growth values R, are easily solved using a hand-held calculator. 
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IV. MONTE CARLO SIMULATIONS 



Since the AMSAA model is interested in the number of trials until the r ,h failure 
occurs, the Monte Carlo simulation generates random variable using an algorithms de- 
veloped by Fishman 197S [Ref. 7] , and a subroutine from The New Naval Postgraduate 
School Random Number Package LLRAN'DOMII 1 9S 1 [Ref. S] as a random number 
generator for real uniform from 0 to 1. Given p , the probability of failure, and r, the 
number of failure for even. - phase, the computer simulation generated the number of 
trials until the /•'* failure. Specifically let A' be the random variable of interest, the num- 
ber of trials until the /•'* failure, then A is called negative binomial random variable with 
parameter r and p. The probability function for X is, 

F > x(k) = Q_f k = r, r + 1, r + 2, ... r>0 

The Algorithms for Computer Simulation : 

1. let A and B be double precision variables 

2. w = {p)' 

3. Ifr<0, (1 — p)<0, (1 — p) > 1 , w < 0 , w > 1 go to 9 

4. X = r, A = w, B = w and 9 = (1 — p)(r — 1) 

5. Generate U, uniform random number from 0 to 1 

6. IfC<T or A > 0.999999 or B <0.000001, goto 10 

7. A'=A'+1, B= B{6IX+ (1 -p)) and A = A + B 

S. Go to 4 

9. Print error message and stop 

10. Continue. 

[Ref. 7 page 354]. 
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V. TEST PROCEDURE 



The AMSAA model is evaluated using eight different sets of reliability values (the 
actual growth pattern) and two dilTerent sets of inputs of number of failure per phase. 
This gives a total of sixteen cases. Table 1 describes all 16 cases. The set of reliability 
values for case i is the same as that for case / + S , / = 1, 2, ... , S. For cases 1 through 
8 the number of failures per phase are equal to one and for cases 9 through 16 the 
number of failures per phase are equal to three. The diagram in Figure 1 summarizes 
the simulation procedure and the consequent analysis. 



Table l. ACTUAL RELIABILITY FOR 16 CASES 



>> 


CASE NUMBERS 


¥1 


1,9 


2,10 


3,11 


4,12 


5,13 


6,14 


7,15 


S, 1 6 


i 


.600463 


.40S036 


.S99215 


.408036 


.40S036 


.40S036 


.4047S6 


.400000 




.600463 


.40S036 


.899215 


.804273 


.804273 


.691333 


.59S442 


.430000 


3 


.600463 


.40S036 


.899215 


.950990 


.S94416 


.804273 


.796763 


.4S0000 


4 


.600463 


.408036 


.S99215 


.975249 


.S99963 


.603542 


.796763 


.540000 


5 


.600463 


.408036 


.S99215 


.990040 


.899963 


.600463 


.802460 


.610000 


6 


.600463 


.40S036 


.899215 


.990040 


.S99963 


.755720 


.802460 


.700000 


7 


.600463 


.408036 


.899215 


.990040 


.899963 


.849243 


.857S02 


.sooooo 


8 


.600463 


.40S036 


.899215 


.990040 


.899963 


.S94416 


.902960 


.900000 


9 


.600463 


.408036 


.899215 


.990040 


.899963 


.903636 


.902960 


.950000 


10 


.600463 


.408036 


.899215 


.990040 


.S99963 


.903636 


.902960 


.990000 
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Figure I. Block diagram of the analysis 
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VI. ANALYSIS PROCEDURE 



A. ACCURACY 

F igures 4 through 35 in the Appendix provide a \isual display of the AMSAA dis- 
crete reliability growth model accuracy by computing the growth line for the AMSAA 
with the actual reliability growth pattern. These graphs also provide plots for the Ex- 
ponential discrete reliability growth model using the same input data as that used in the 
AMSAA discrete reliability growth model. 

B. VARIABILITY 

In addition to the tracking ability of the reliability point estimates R, , the user is 
also interested in the variability of R r Five hundred replications were run lor each of 
the 16 cases and each of the 10 phases, this provided : 



for /= 1,2 10 for each of the 16 cases. 

The algorithm used to compute the mean and standard deviation is developed by 
Miller 1982 [Ref. 9 page 17 to 19], Standard deviation of the reliability estimates from 
both the AMSAA and the Exponential model are plotted. 




and. 
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C. CONFIDENCE INTERVAL 



A 95“ 
16 cases. 

i)=R r 

and, 

Li=Rf 
for i = 



o two sided confidence interval for /:[/?,] is computed for each model for all 
The equation used for these confidence limits arc as follows : 

(1.96)5^ 

■+• — 

, 5U0 



(1.96)5^ 
v 500 

1,2, ....10 for each of the 16 cases. 
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VII. RESULTS AND CONCLUSIONS 



The results for all 16 cases can be seen in the Appendix. The case number appears 
at the table caption or at the figure caption. All of the results for each case are divided 
into two categories, i.e. , the tabulated statistic and performance plot. In this chapter 
Table 2. Figure 2, and Figure 3 are explained as an example of the result from case 1 
of data set. 

A. TABULATED STATISTICS 

Table 2 indicates that testing was done until one failure occured after which a 
change in the item was made. The actual reliability growth values for each of the 10 
phases was constant at 0.60043, i.e., no growth actually occured. It is important to 
simulate this case in order to examine the ability of the growth model to detect no 
growth. Some reliability growth models have a built in assumption that some growth 
always takes place after a design change. 

The values of /?, for i— 1.2 10 are given in column 4 for the AMSAA model 

and in column 8 for the Exponential model, thus for phase 7, the AMSAA model yielded 
/?, = 0.5S01S7 and the Exponential model yielded a value of 0.525144. The 
coresponding values of the standard deviation are 0.124669 and 0.261S54 for the 
AMSAA and the Exponential model respectively. 



B. PERFORMANCE PLOT 

Figure 1 is a plot of R, versus / for the AMSAA and Exponential models. It also 
displays a plot of the actual reliabilities R, . Figure 2 is a plot of standard deviation for 
case 1 for both the AMSAA and the Exponential model. 
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Table 2. STATISTICS FOR CASE I 



> 

— 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


“t: 

> o 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


l 


.600463 


.319489 


.311700 


.346811 


.292167 


.436848 


.3S7013 




1 


.600463 


.485770 


.147713 


.498718 


.472823 


.459899 


.382840 


3 


1 


.600463 


.530347 


.112104 


.540173 


.520521 


.482593 


.316476 


4 


1 


.600463 


.553948 


.103685 


.563037 


.544860 


.515253 


.292478 


5 


1 


.600463 


.569518 


.106661 


.578867 


.560169 


.509663 


.282941 


6 


1 


.600463 


• 5S0187 


.114242 


.590201 


.570173 


.514700 


.271440 


7 


1 


.600463 


.587260 


.124669 


.598187 


.576332 


.525144 


.261854 


8 


1 


.600463 


.592922 


.134212 


.604686 


.581158 


.529729 


.245836 


9 


1 


.600463 


.597331 


.143335 


.609895 


.584767 


.542551 


.240164 


10 


1 


.600463 


.600715 


.151730 


.614014 


.587415 


.550677 


.219819 
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Figure 2. The reliability growth pattern comparison plot case 1 



STANDARD DEVIATION 




Figure 3. The standard deviation comparison plot case 1 
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C. SUMMARY AND CONCLUSIONS 



To analyze the test results for cases 1 through 16, all were divided into categories, 

i.e., constant growth pattern, concave with rapid growth pattern, concave and convex 
growth pattern, convex growth pattern (see Appendix). 

1. Constant Growth Pattern 

The AMSAA model didn't track the actual reliability too well for cases 1, 2, and 
3 (the number of failure per phase was set equal to one). The AMSAA developed a 
concave growth pattern, eventhough in these cases the actual reliability was constant. 
Furthermore for case 3 the AMSAA model performance became worse since it had de- 
creasing pattern and went below the actual reliability at phase 10. However when the 
number of failure increased to three, the AMSAA model tracked the actual reliability 
quite well. The mean of the estimate of reliability was close to the actual reliability, and 
the standard deviation of the estimate of reliability was very small. 

2. Concave with Rapid Growth Pattern 

This type of actual reliability growth pattern is represented in cases 4, 5, 12. and 
13. The AMSAA model performed well in tracking actual reliability growth, especially 
for case 4, case 5, and case 13, where it is close to the actual reliability with very small 
standard deviation of the estimate of reliability. For case 12, the AMSAA model for 
some reason could not track the actual reliability very well. It performed almost con- 
stant growth, with a small decrease out through phase 10. This is a strange phenomena. 
This case was run several times with the same result. 

3. Concave and Convex Growth Pattern 

The AMSAA model has a problem tracking reliability growth pattern estab- 
lished in cases 6, 7, 14, and 15. The AMSAA model seems to display a concave growth 
pattern, it could not track the actual reliability which has a concave followed by a con- 
vex growth pattern. This is probably because the cumulative assumption inherent in 
the AMSAA model does not work well when the reliability growth has a convex growth 
pattern. 
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4. Convex Growth Pattern 

The A M S A A model also had difficulty in tracking the actual reliability growth 
pattern for cases S and 16, it just performed concave growth pattern for both cases. 
The standard deviation of the estimate of reliability was good in these cases. 

5. Summary 

It appears that the AMSAA discrete reliability growth model is more appropri- 
ate for reliability growth pattern that has the following characteristics : 

1. Concave with rapid growth pattern 

2. Constant growth pattern with number of failure specified more than one. 

It appears that the user should be wary of using the AMSAA discrete reliability 
growth model when the actual reliability growth has the following characteristics : 

1. Constant growth pattern with number of failures specified equal to one 

2. Concave growth followed by convex growth pattern 

3. Convex growth pattern. 

Also the user should note that other discrete reliability growth models are available 
which for some growth pattern performed better than the AMSAA model and which can 
be programmed on a hand-held calculator. 



17 



APPENDIX SIMULATION RESULTS : CASE 1 TO CASE 16 



Table 3. STATISTICS FOR CASE 1 



•ISVILI 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


vT'Sfc 

— ^ 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


l 


.600463 


.3194S9 


.311700 


.34681 1 


.292167 


.436S48 


.387013 


2 


l 


.600463 


.4S5770 


.147713 


.498718 


.472823 


.459899 


.3S2S40 


-> 

J 


l 


.600463 


.530347 


.112104 


.540173 


.520521 


.482593 


.316476 


4 


l 


.600463 


.553948 


.103685 


.563037 


.544860 


.515253 


.292478 


5 


l 


.600463 


.569518 


.106661 


.578867 


.560169 


.509663 


.282941 


6 


l 


.600463 


.580187 


.114242 


.590201 


.570173 


.514700 


.271440 


7 


l 


.600463 


.587260 


.124669 


.598187 


.576332 


.525144 


.261854 


S 


l 


.600463 


.592922 


.134212 


.604686 


.581158 


.529729 


.245836 


9 


l 


.600463 


.597331 


.143335 


.609895 


.584767 


.542551 


.240164 


10 


1 


.600463 


.600715 


.151730 


.614014 


.587415 


.550677 


.219819 
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STANDARD DEVIATION 




Figure 5. The standard deviation comparison plot case 1 
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Table 4. STATISTICS FOR CASF. 2 



> 








OUTPUT of COMPUTER RUN 




s 


INPUT 
















DATA 




AMSAA 


MODEL 




EXPONENTIAL 

MODEL 




O' 

— . o 


AC- 

TUAL 

RLBT 


MEAN 
of the 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 


STD 

DEV 

of 

RGRS 

EST 






EST of 
RLBT 


UPPER 


LOWER 


RGRS 

EST 


1 


1 


.403086 


.416346 


.365885 


.448417 


.384274 


.277941 


.350039 




1 


.403086 


.462381 


.232197 


.4S2733 


.442028 


.313160 


.354467 


3 


1 


.403086 


.459150 


.173415 


.474351 


.443950 


.345541 


.294778 


4 


1 


.403086 


.448116 


.133658 


.459831 


.436400 


.350302 


.278155 


5 


1 


.403086 


.431723 


.109715 


.441340 


.422106 


.332342 


.274627 


6 


1 


.403086 


.413006 


.110047 


.422652 


.403360 


.342188 


.266326 


7 


1 


.403086 


.394704 


.128997 


.406011 


.383397 


.340337 


.252991 


8 


1 


.403086 


.376635 


.157304 


.390424 


.362847 


.348798 


.246473 


9 


1 


.403086 


.360838 


. 186914 


.377221 


.344454 


.359013 


.239996 


10 


1 


.403086 


.346454 


.215615 


.365353 


.327554 


.380852 


.232067 
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Figure 6. The reliability growth pattern comparison plot case 2 



STANDARD DEVIATION 




Figure 7. The standard deviation comparison plot case 2 
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Table 5. STATISTICS FOR CASE 3 



> 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 




AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


I 


.899215 


.397305 


.339065 


.427025 


.367585 


.784433 


.293429 


T 


I 


.899215 


.764665 


.098591 


.773307 


.756023 


.797078 


.288337 


3 


1 


.899215 


.839154 


.060455 


.844453 


.833855 


.S22922 


.225154 


4 


1 


.899215 


.868815 


.046403 


.S72882 


.864747 


.837676 


.1S6795 


5 


1 


.899215 


.S85368 


.041623 


.S89016 


.881719 


.834702 


.192540 


6 


I 


.899215 


.896082 


.039685 


.899561 


.892603 


.852273 


.159859 


7 


1 


.899215 


.903360 


.039227 


.906798 


.899921 


.S5S921 


.134809 


S 


1 


.899215 


.908869 


.039064 


.913293 


.905444 


.869732 


.120620 


9 


I 


.899215 


.913205 


.038957 


.916620 


.909790 


.870845 


.119773 


10 


1 


.899215 


.916762 


.038813 


.920164 


.913360 


.876847 


.109467 




STANDARD DEVIATION 




Figure 9. The standard deviation comparison plot case 3 
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Table 6. STATISTICS FOR CASE 4 



> 








OUTPUT of COMPUTER RUN 






INPUT 
















DATA 


AMSAA MODEL 


EXPONENTIAL 

MODEL 




— 2. 


AC- 

TUAL 

RLBT 


MEAN 
of the 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 


STD 

DEV 

of 

RGRS 

EST 






EST of 
RLBT 


UPPER 


LOWER 


RGRS 

EST 


1 


i 


.403086 


.247188 


.301170 


.273586 


.2207S9 


.277941 


.350039 


T 


i 


.804723 


.831764 


.062S44 


.837272 


.S26255 


.692599 


.334232 


3 


i 


.950990 


.923927 


.033311 


.926847 


.921007 


.900547 


.166031 


4 


i 


.975249 


.960687 


.019283 


.962377 


.958997 


.960575 


.075075 


5 


i 


.990040 


.978110 


.013216 


.979269 


.976952 


.985843 


.022317 


6 


i 


.990040 


.985506 


.011104 


.986480 


.984533 


.993530 


.022859 


7 


i 


i 

.990040 


.9SS832 


.009410 


.989657 


.98S007 


.993346 


.011663 


8 


i 


.990040 


.990717 


.009306 


.991532 


.991066 


.994365 


.010904 


9 


i 


.990040 


.9918S9 


.0093S4 


.992711 


.991066 


.994678 


.009990 


10 


i 


.990040 


.992741 


.008820 


.993514 


.991968 


.994922 


.009867 
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Figure 10. The reliability growth pattern comparison plot case 4 



STANDARD DEVIATION 




Figure 11. The standard deviation comparison plot case 4 
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Table 7. STATISTICS FOR CASE 5 



PI IASI: 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


>'=* 

— o 

— ”7 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


1 


.4030S6 


.304970 


.3 197S8 


.333001 


.276939 


.277941 


.350039 


T 


1 


.804723 


.716657 


.099573 


.725385 


.707929 


.692599 


.334232 


3 


1 


.S94416 


.SI 1904 


.0638S2 


.817504 


.806305 


.S 16604 


.229131 


4 


1 


.S99963 


.854719 


.050648 


.859159 


.850280 


.S57286 


.180176 


5 


1 


.S99963 


.S77544 


.045115 


.881498 


.8735S9 


.854640 


.201203 


6 


1 


.899963 


.891553 


.042322 


.895262 


.887843 


.852018 


.233083 


7 


1 


.S99963 


.900743 


.041174 


.904352 


.897134 


.SS3001 


.196564 


8 


1 


.899963 


.907577 


.040321 


.911111 


.904042 


.880019 


.208935 


9 


l 


.899963 


.912850 


.039735 


.916332 


.909367 


.886436 


.209224 


10 


1 


.899963 


.917156 


.038932 


.920568 


.913743 


.889895 


.215450 
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Figure 12. The reliability growth pattern comparison plot case 5 



STANDARD DEVIATION 




Figure 13. The standard deviation comparison plot case 5 
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Table 8. STATISTICS FOR CASE 6 



> 








OUTPUT of COMPUTER RUN 




— 


INPUT 
















DATA 


AMSAA MODEL 


EXPONENTIAL 

MODEL 




>*= 

— o 

— — 5 


AC- 

TUAL 

RLBT 


MEAN 
of the 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 


STD 

DEV 

of 

RGRS 

EST 






EST of 
RLBT 


UPPER 


LOWER 


RGRS 

EST 


1 


1 


.403086 


.224899 


.271434 


.248692 


.201107 


.277941 


.350039 


2 


1 


.691333 


.630239 


.101236 


.639112 


.621365 


.566627 


.371685 




1 


.S04723 


.728316 


.078056 


.735158 


.721474 


.702538 


.282617 


4 


1 


.603542 


.768103 


.070584 


.774289 


.761916 


.649254 


.242711 


5 


1 


.600463 


.7S7819 


.064749 


.793495 


.782144 


.609683 


.240854 


6 


1 


.755710 


.805681 


.061914 


.811108 


.S00254 


.674674 


.217185 


7 


1 


.S49243 


.823900 


.062269 


.829358 


.818442 


.763961 


.167637 


8 


1 


.894416 


.841536 


.063679 


.847117 


.835954 


.830485 


.122824 


9 


1 


.903636 


.S55559 


.064934 


.861250 


.849867 


.865976 


.105627 


10 


1 


.903636 


.866080 


.064945 


.871772 


.860387 


.889152 


.084728 
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Figure 14. The reliability growth pattern comparison plot case 6 
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Figure 15. The standard deviation comparison plot case 6 



Table 9. STATISTICS FOR CASE 7 



PHASE 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


I? 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


1 


.404786 


.304970 


.319788 


.333001 


.276939 


.262647 


.346369 




1 


.59S442 


.716657 


.099573 


.725385 


.707929 


.474285 


.378478 


J 


1 


.796763 


.SI 1904 


.063SS2 


.817504 


.806305 


.67S456 


.301077 


4 


1 


.796763 


.854719 


.050648 


.859159 


.8502S0 


.747581 


.244811 


5 


1 


.S02460 


.877544 


.045115 


.881498 


.873589 


.752545 


.242109 


6 


1 


.802460 


.891553 


.042322 


.895262 


.887843 


.764293 


.257599 


7 


1 


.S57S02 


.900743 


.041174 


.904352 


.897134 


.816030 


.237079 


8 


1 


.902960 


.907577 


.040321 


.911111 


.904042 


.842211 


.241987 


9 


1 


.902960 


.912850 


.039735 


.916332 


.909367 


.853594 


.251411 


10 


1 


.902960 


.917156 


.03S932 


.92056S 


.913743 


.855511 


.253041 
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Figure 16. The reliability growth pattern comparison plot case 7 



STANDARD DEVIATION 




Figure 17. The standard deviation comparison plot case 7 
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Table 10. STATISTICS FOR CASE 8 



> 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


go 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


SID 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


1 


.400000 


.149057 


.192978 


.165972 


.132142 


.271768 


.344556 


“> 


1 


.430000 


.687404 


.080545 


.694464 


.680344 


.305861 


.350305 


3 


1 


.4S0000 


.769958 


.064798 


.775638 


.764279 


.389910 


.3217S3 


4 


1 


.540000 


.812713 


.056419 


.817658 


.807767 


.449303 


.284744 


5 


1 


.610000 


.S41962 


.051100 


.S46441 


.837483 


.561109 


.261834 


6 


1 


.700000 


.864439 


.047810 


.868630 


.860249 


.621144 


.238394 


7 


1 


.sooooo 


.883576 


.045648 


.8S7577 


.879575 


.712991 


.196329 


8 


1 


.900000 


.903105 


.043961 


.906959 


.899252 


.816562 


.138561 


9 


1 


.950000 


.922076 


.042662 


.925816 


.91S337 


.894838 


.0S7652 


10 


1 


.990000 


.945008 


.042874 


.948766 


.941250 


.959923 


.034246 
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Figure 18. The reliability growth pattern comparison plot case 8 



STANDARD DEVIATION 




Figure 19. The standard deviation comparison plot case 8 
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Table 1 1. STATISTICS FOR CASE 9 



> 

:/2 


INPUT 
DA 1 A 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


— o 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
M LAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

ESP 


UPPER 


LOWER 


1 


3 


.600463 


.53SS02 


.186346 


.555136 


.522168 


.553655 


.210395 


2 


3 


.600463 


.576379 


.086393 


.583952 


.568807 


.563631 


.218474 


3 


3 


.600463 


.5S5S66 


.063621 


.591443 


.580289 


.560046 


.196348 


4 


3 


.600463 


.5901S6 


.057592 


.595234 


.585138 


.571343 


.179061 


5 


s 

J 


.600463 


.592796 


.058542 


.597928 


.587665 


.583947 


.154435 


6 


J 


.600463 


.594467 


.062527 


.599947 


.588986 


.586601 


.147665 


7 


J 


.600463 


.595507 


.067578 


.601431 


.589584 


.587442 


.140020 


8 


3 


.600463 


.596269 


.072753 


.602646 


.589891 


.586170 


.137124 


9 


3 


.600463 


.596791 


.077717 


.603603 


.589979 


.592676 


.123858 


10 


3 


.600463 


.596975 


.082442 


.604201 


.5S9749 


.589863 


.116577 
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Figure 20. The reliability growth pattern comparison plot case 9 



STANDARD DEVIATION 




Figure 21. The standard deviation comparison plot case 9 
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Table 12. STATISTICS FOR CASE 10 



•ISVIU 


INPUT 
DA FA 


OUTPUT of COMPUTER RUN 


A MSA A MODEL 


EXPONENTIAL 

MODEL 


— o 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


SID 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


3 


.403086 


.365701 


.228152 


.385700 


.345703 


.348426 


.225386 


2 


3 


.403086 


.398549 


.130351 


.409974 


.387123 


.375728 


.235090 


3 


3 


.403086 


.404570 


.096573 


.413035 


.396105 


.378259 


.202326 


4 




.403086 


.405363 


.077487 


.412155 


.398571 


.391223 


.180188 


5 


3 


.4030S6 


.404514 


.068972 


.410559 


.398468 


.400S76 


.173112 


6 


3 


.403086 


.402537 


.070057 


.408678 


.396397 


.403065 


.165447 


-T 

/ 




.403086 


.399935 


.078909 


.406851 


.393018 


.399075 


.157684 


8 


3 


.403086 


.397170 


.091792 


.405216 


.389124 


.393748 


.154780 


9 


3 


.403086 


.394409 


.106329 


.403729 


.385089 


.400769 


.139954 


10 


3 


.403086 


.391858 


.119968 


.402374 


.381342 


.396248 


.130672 
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Figure 22 . The reliability growth pattern comparison plot case 10 
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Figure 23. The standard deviation comparison plot case 10 



Table 13. STATISTICS FOR CASE 11 



> 

:/2 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


A MSA A MODEL 


EXPONENTIAL 

MODEL 


— o 
; — — ) 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

es r of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


1 

UPPER 


LOWER 


1 


3 


.S99215 


.S7470S 


.075400 


.881317 


.S6S099 


.875154 


.097891 


2 


3 


.899215 


.890215 


.030085 


.892852 


.887578 


.874634 


.108637 


3 


3 


.899215 


.S93745 


.022208 


.S95692 


.89179S 


.881110 


.080530 


4 


3 


.899215 


.895290 


.019S09 


.897027 


.893554 


.S85150 


.0716S5 


5 


3 


.S99215 


.S96174 


.019993 


-S97927 


.894422 


.887219 


.062968 


6 


3 


.899215 


.S96677 


.021320 


.S98545 


.894S08 


.889853 


.058065 


7 




.S99215 


.896921 


.022891 


.898928 


.894915 


.890704 


.054956 


8 


3 


.899215 


.897091 


.024281 


.899219 


.894962 


.890799 


.051037 


9 


3 


.899215 


.S97191 


.026041 


.899473 


.S9490S 


.S93297 


.045739 


10 


3 


.899215 


.897171 


.027662 


.899596 


.894747 


.892541 


.043866 
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Figure 24. The reliability growth pattern comparison plot case 1 1 
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Figure 25. The standard deviation comparison plot case 11 
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Table 14. STATISTICS FOR CASE 12 



— 


















> 








OUTPUT of COMPUTER RUN 






INPUT 
















DATA 






















A MSA A MODEL 




EXPONENTIAL 

MODEL 




> 

— 


AC- 

TUAL 

RLBT 


MEAN 
of the 


STD 
DEV of 
the 

EST of 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 


STD 

DEV 

of 

RGRS 






EST of 
RLBT 






RGRS 

EST 








RLBT 


UPPER 


LOWER 


EST 


1 




.4030S6 


.841201 


.098829 


.S49864 


.832538 


.348426 


.225386 


A. 


j 


.804723 


.849013 


.046282 


.853069 


.844956 


.771284 


.162229 


3 


3 


.950990 


.841209 


.050197 


.845609 


.836809 


.939463 


.044327 


4 


3 


.975249 


.833962 


.07S297 


.840825 


.827099 


.976039 


.017360 


5 


3 


.990040 


.830465 


.090770 


.838422 


.822509 


.990117 


.010184 


6 


3 


.990040 


.829695 


.091803 


.837830 


.821561 


.993581 


.009200 


7 


3 


.990040 


.828934 


.094S42 


.837247 


.820620 


.994S06 


.008335 


S 


3 


.990040 


.828181 


.096894 


.836674 


.819688 


.995307 


.008680 


9 


J 


.990040 


.827444 


.098868 


.836110 


.S 1 8778 


.995613 


.008335 


10 


3 


.990040 


.826714 


.100896 


.835558 


.817870 


.995641 


.008335 
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Figure 26. The reliability growth pattern comparison plot case 12 



STANDARD DEVIATION 




Figure 27. The standard deviation comparison plot case 12 
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Table 15. STATISTICS FOR CASE 13 



> 

ir, 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 




AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


y 

J 


.4030S6 


.421329 


.242162 


.44255b 


.400103 


.34S426 


.225386 


*> 


3 


.804723 


.751290 


.060248 


.756570 


.746009 


.771284 


.162229 


3 


y 


.894416 


.833149 


.034031 


.836132 


.830166 


.887470 


.074325 


4 


3 


.899963 


.868939 


.026237 


.871239 


.866639 


.913950 


.052619 


5 


3 


.S99963 


.8S7645 


.023565 


.889711 


.885580 


.921667 


.042965 


6 


3 


.899963 


.899931 


.022328 


.901348 


.897433 


.924828 


.039463 


7 


3 


.899963 


.907487 


.021942 


.909410 


.905564 


.925187 


.037596 


8 


3 


.899963 


.913555 


.021536 


.915443 


.911667 


.924395 


.035405 


9 


3 


.899963 


.918287 


.021365 


.920160 


.916414 


.925071 


.031639 


10 


y 

J 


.899963 


.922147 


.021066 


.923994 


.920301 


.923207 


.031085 
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Figure 28. The reliability growth pattern comparison plot case 13 



STANDARD DEVIATION 




Figure 29. The standard deviation comparison plot case 13 
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Table 16. STATISTICS FOR CASE 14 



> 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


7£i- 

> " 

— O 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


3 


.4030S6 


.299748 


.1960SS 


.316936 


.2S2561 


.348426 


.225386 




3 


.691333 


.659017 


.06209S 


.664460 


.653574 


.655112 


.193326 


J 


j 


.S04723 


.750623 


.043777 


.754460 


.746785 


.788019 


.117403 


4 


3 


.603542 


.787263 


.038458 


.790634 


.783892 


.7136S2 


.126110 


5 


3 


.600463 


.S03674 


.034742 


.806720 


.S00629 


.671260 


.120385 


6 


3 


.755710 


.S19347 


.032614 


.822205 


.8164S8 


.720426 


.110446 


7 


J 


.849243 


.S36709 


.0323S0 


.S3954S 


.S33S71 


.794972 


.0S4335 


8 


3 


.894416 


.853894 


.032927 


.8567S0 


.851008 


.851854 


.063108 


9 


3 


.903636 


.86782S 


.033429 


.S7075S 


.864S97 


.SS6990 


.044668 


10 


3 


.903636 


.878133 


.033186 


.S81042 


.875224 


.903086 


.038209 
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Figure 30. The reliability growth pattern comparison plot case 14 
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Table 17. STATISTICS FOR CASE 15 



IM 1 AST. 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


AMSAA MODEL 


EXPONENTIAL 

MODEL 


* » -H- 

- o 


AC- 

TUAL 

RLBT 


MEAN 
of the 
EST of 
RLBT 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


3 


.4047S6 


.421329 


.242162 


.442556 


.400103 


.351763 


.225708 


2 


3 


.598442 


.751290 


.060248 


.756570 


.746009 


.561042 


.219588 


3 


■> 


.796763 


.S33149 


.034031 


.836132 


.830166 


.761750 


. 12S729 


4 




.796763 


.86S939 


.026237 


.871239 


.866639 


.807520 


.102913 


5 


3 


.S02460 


.S87645 


.023565 


.889711 


.885580 


.828525 


.0S0055 


6 


3 


.802460 


.899391 


.022328 


.901348 


.897433 


.836119 


.073760 


7 




.S57S02 


.907487 


.021942 


.909410 


.905564 


.860585 


.061728 


S 


3 


.902960 


.913555 


.021536 


.915443 


.911667 


.890172 


.048793 


9 


3 


.902960 


.9182S7 


.021365 


.920160 


.916414 


.907881 


.037583 


10 


3 


.902960 


.922147 


.021066 


.923994 


.920301 


.915806 


.033604 
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Figure 32. The reliability grontli pattern comparison plot case 15 



STANDARD DEVIATION 




Figure 33. The standard deviation comparison plot case 15 
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Table 18. STATISTICS FOR CASE 16 



PHASE 


INPUT 

DATA 


OUTPUT of COMPUTER RUN 


A MSA A MODEL 


EXPONENTIAL 

MODEL 


— o 


AC- 
‘1 UAL 
RLBT 


MEAN 
of the 
EST of 
RLB r 


STD 
DEV of 
the 

EST of 
RLBT 


95% Cl of the 
MEAN of RLBT 


MEAN 

of 

RGRS 

EST 


STD 

DEV 

of 

RGRS 

EST 


UPPER 


LOWER 


1 


J 


.400000 


.228712 


.160711 


.242799 


.214625 


.344437 


.225569 




3 


.430000 


.594215 


.066121 


.600011 


.588419 


.400345 


.238088 


3 


3 


.480000 


.672784 


.053963 


.677514 


.66S054 


.444004 


.202921 


4 


-> 

j 


.540000 


.716845 


.049957 


.721224 


.712466 


.506867 


.180221 


5 


j 


.610000 


.748614 


.048121 


.752S32 


.744396 


.578905 


.150044 


6 


J 


.700000 


.774650 


.047420 


.778807 


.770494 


.659072 


.127605 


7 


*> 

j 


.800000 


.798445 


.047698 


.802626 


.794264 


.746996 


.099554 


8 


J 


.900000 


.824266 


.048878 


.828550 


.819981 


.839623 


.066243 


9 


3 


.950000 


.851483 


.050970 


.855951 


.847016 


.909948 


.036966 


10 


3 


.990000 


.863599 


.051552 


.868118 


.859080 


.964163 


.016538 
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Figure 34. The reliability growth pattern comparison plot case 16 
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